Antonyms for the phrase "hold sway over" include relinquish control, abandon authority, release influence, and surrender jurisdiction. These antonyms signify a lack of power or authority over a particular situation or individual. Other antonyms for "hold sway over" may include forsake domination, cede mastery, or waive power. These terms suggest a relinquishment or surrender of control, allowing others to take the lead or set the direction. The choice to abandon or release influence can be difficult, but sometimes it is necessary to allow others to grow and develop in their own way.